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SECTION 1: INTRODUCTION 


1.1 PURPOSE 

The purpose of this informal status report is three- fold: 

a) To summarize the research effort that has been expended on this project 
in relation to the specific tasks that were embodied in the original 
research proposal. 

b) To document this research effort by presenting major results and the 
conclusions that can be drawn from them. 

c) To indicate those directions that seem most fruitful for continued 
investigation and to suggest certain tasks that might be abandoned in 
any follow-on effort. 

The style of presentation is concise and limited to end-results without the 
preliminary analysis. The docimentation consists of specific computer- generated 
, curves selected from a much larger set of existing outputs. In discussing the 
conclusions a careful distinction is made between those that are tentative and 
those that are firm. 

1.2 SUMMARY OF RESEARCH EFFORT 

The specific tasks contained in the original research proposal are itemized, 
with some elaboration, in Table I along with an indication of the degree of effort 
that has been devoted to them and a summary of the major conclusions. These 
items are then expanded upon in Section 2. 

Even a casual Inspection of Table I makes it clear that the original research 
proposal was over-ambitious in terms of what could be accomplished by one or two 
inexperienced graduate students. This difficulty is easily overcome, of course, 
by extending the investigation over a longer time period * 



TABLE I: SUMMARY OF PROPOSED TASKS 
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TABLE I (CONTINUED) 
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However, a more serious criticism of 'the research effort to date is that 
it has been over- concerned with the investigation of some rather standard and 
prosaic estimation and detection procedures and has not really resolved the 
fundamental theoretical issues that must limit any practical solution. The 
concentration on standard transform methods that are computationally cumbersome 
because they ignore the available a priori Information about the signal is an 
example of this. This aspect of the research effort, and some possible 
alternatives, are discussed in Section 3. 


SECTION 2: DOCUMENTATION OF RESULTS 


2.1 INTRODUCTION 

The only topics discussed in detail in this section are those tasks from 
Table I for which there are some significant results. Other tasks that have 
not been carried to the point of reaching conclusions are noted briefly in a 
final sub-section, and tasks on which no effort has been expended are not 
considered at all. 

The documentation consists of stating the objective of each task, presenting 
the pertinent equations, displaying typical curves (where appropriate) illustrating 
the results, and stating the major conclusions. 

2.2 FAST FOURIER TRANSFORM (FFT) METHODS OF COARSE FREQUENCY MEASUREMENT 
2.2.1 Oblectives 

, An obvious method of deciding whether or not a short sample of observed data 
contains one or more sinusoids is to examine the frequency spectrum of that 
sample. If the duration, T, of the sample is great enough, and the noise is 
small enough, then separate peaks in the frequency spectrum will indicate the 
presence of sinusoids at (or near) the frequencies at which the peaks occur. 

The degree to which two or more frequency components can be resolved depends 
upon both the sample duration, T, and variance of the estimate of the frequency 
spectrum. When the estimated spectrum is smoothed in order to reduce the variance, 
the sharpness of the peaks (and, hence, the resolution) is reduced. Thus, there 
is a trade-off between resolution and variance and there is an optimum degree of 
smoothing that should be used. 

The ultimate objective in using the Fast Fourier transform in an investi- 
gation of coarse frequency measurements is to determine the optimum amount of 
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smoothing to use and thereby gain insight into the fundamental trade-offs. The 
reason for using Fourier methods, rather than methods that are computationally 
more efficient, is that the results are not obscured by the idiosycrasies of 
more specialized techniques that are not well understood. It is not anticipated 
that Fourier methods will be used in the final system realization because of the 
excessive amount of computation required. 


2.2.2 Discussion of Results 

When noise is present the Fourier transform, which is sensitive to phase, 
is not a good indicator of the frequency spectrum. The power spectrum, or spectral 
density, avoids the phase problem and exhibits greater statistical stability, 
particularly when smoothed appropriately. If the observed data in time T is 
represented by a set of N samples denoted by X^, k = 0, 1, ..., N- 1, then the 
Fourier coefficient associated with a frequency of f^ » n/T is given by 


A 

n 


I ' 


n e 0, 1, ...» N-1 


( 2 - 1 ) 


and the corresponding power sF>ectrum (as computed by the direct method) is 


P(n/T) = I 


( 2 - 2 ) 


The power spectrum can also be computed by the indirect method in which the 
autocorrelation function is first estimated from 


N-n-1 

R(nT/N) = X \ *k+n » n = 0, 1, . . . , N-1 (2-3) 

k=0 

The power spectrxun is then the Fourier cosine transform of the autocorrelation 


function. Thus 
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N-2 

P(n/T) B + R(T) cos(N-l)7I + 2 ^ R(kT/N) cos (2-J|) 

k=l 

This spectrum is essentially equivalent to that of (2-2) but it does not have the 
same statistical properties. Although some work has been done on the indirect 
method, all of the results to be presented here were obtained by the direct method. 

In order to smooth the spectral estimates of either (2-2) or (2-4) they 
must be convolved with an appropriate spectral window, W(k). Thus, the smoothed 
estimate is 

L 

Pj^(n/T) B ^ W(n-k) P(k/T) n b o, I, . . . , N/2 

in < N/2 (2-5) 

Under suitable assumptions on the correlation between estimates land smoothness 
of the true spectrum, it can be shown that 

L 

, E[Pj^(n/T)] b ^ W(k) E[p(n/T)] (2-6) 

kB-L 


L 

Var[Pj^(n/T)J » ^ W^(k) Var[p(n/T)] (2-?) 

k=-L 


L 

This suggests that ^ w(k) b 1 is the condition for an unbiased smoothed 

k"-L 

estimate when the raw estimate is unbiased. A measure of the reduction in 
variance of an unbiased estimate is given by 


4 '- 

% 


1 

W^(k) 

kB-L 


(2-8) 


where is usually referred to as the degrees of freedom. 


A large value of 
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^ is desirable in order to reduce the variance of the estimate as much as possible. 
The equivalent spectral width of the estimate of a single frequency 

I 

component is also proportional to In particular, it has the form 


2T 


Hz 


(2-9) 


Thus, any attempt to reduce the variance of the estimate will result In a 

corresponding Increase in the spectral width of a single component. The 

S 

objective, therefore, is to find the value of^ that maximizes the probability 
of correctly detecting a given set of signal components. This problem is 
addressed further in Sec. 2.6. ' 

s 

An approximate indication of a reasonable value of ^ is obtained from the 
parameters of the physical situation. If it is desired to identify sinusoidal 
components having frequencies separated by 300 Hz, then should be on the order 
of 300 Hz. If the sample length is T e o. 01, then from (2-9) 

Q = 2B^T = 2 (300) (0. 01) •* 6 (2-10) 


A large number of power spectra for sinusoids with and without noise have 

been computed. Since there is no problem in correctly identifying the 

frequencies present in the noise-free case, the discussion here will concentrate 

on the noisy case only. The power spectra displayed In Figs. 1, 2, and 3 are 

typical of the results. In each of these there are two signals of equal 
“».or 

amplitude at Jr kHz and 23 kHz with varying amounts of noise. In Fig. 1 the 
signal-to-noise ratio (power in either signal to the total noise power in the 
<- 30 kHz band) is -10 dB for both spectra, but different noise samples are used 

i 

for the top and bottom calculations. Fig. 2 presents the same situation for 
-14 dB signal-to-noise ratio and Fig. 3 repeats this for -I 5 dB. A noticeable 
degradation in detectability of the signal peaks occurs in this later case. 


0 HCC3 80K 120C3 16CC3 SOOCC 2MCK CS030 SiOCC 

FREQUENCY 

Fig. 1. Power spectra when each signal is >10 dB below the total 
noise. Upper and lower curves are for the same signals 
but different realizations of the noise^ the 
ts 
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2.2.'^ Conclusions 

The results presented In the preceding curves, and the more extensive 
calculations of a similar nature that have been performed. Indicate a number of 
conclusions that can be dravm. Those conclusions that seem to be firmly estab- 
lished are: 

a) Signals for which the signal-to-noise ratio (in the entire band) is greater 
than -Ib^ dB are clearly detectable. 

b) Signals for which the signal-to-noise ratio is less than -I 5 dB cannot be 
detected reliably. 

c) Some smoothing of the spectral estimate is necessary for reliable detection, 
but the optimum trade-off between detection and resolution has not yet 
been established. 

A tentative conclusion concerning the FFT Is that It may be too time-consuming 
to allow the preamble to be shortened significantly. A preliminary estimate of 
the time required to compute the power spectrum from 1024 samples of data 
(gathered in 10 ms) and make the decisions as to the presence or absence of 
signals indicates that it would take about 40 ms with LSI logic or about 100 ms 
with IC logic. Hence, real-time computation is not possible and the number of 
complete computations that could be made in each signal would be limited. 

2.3 FAST WALSH- HAD AMARD TRANSFORM (fHT) METHODS 
OF CX)ARSE FREQUENCY MEASUREMENT 

2.3.1 Objectives 

The Walsh basis functions are binary valued and can be described in terms 
of their zero crossings in a manner similar to that used for the sinusoidal 
basis functions of the Fourier transform. Hence, the average number of zero- 
crossings per second divided by two is the sequency and is related to the 
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frequency of sinusoids. 

The objective in considering Walsh- Hadamard transforms is to reduce the 
computation time since each transform requires only N log 2 N real additions 
and no multiplications. 

2.^.2 Discussion of Results 

As in the case of Fourier methods it is desirable to consider the power 
spectrum (as a function of sequency) rather than the basic transform. Unlike 
the Fourier case, however, even the power spectrum is not Invariant to time 
shifts. The discrete transform is defined as 

N-1 

®n ” I! wal(n,k) , n = 0, 1, ...,N-1 (2-11) 

k=0 

where wal(n,k) is the k th sample of the nth basis function. In this case n 
represents the number of zero-crossings in the interval on which the basis 
function is defined. The corresponding sequency power spectrum is 

S(n/T) = I (2-12) 

The sequency power spectrum has been calculated for a large number of 
situations containing one and two signals at different frequencies and frequency 
separations. Some of these' results are illustrated in Figs. U thru 7* of 

these computations have been made for the case of iw noise. No computations 
have been performed for the noisy case. 

It is clear that in most cases maxima of the sequency power spectra do occur 
' at the sequencies of the signal components. There are some unusual situations 
that arise, however. In all cases there are sub-maxima that occur on either 
side of the main peak. Usually these side lobes are smaller than the main peak 
but occasionally they can be larger. For an example of this, see Fig. 6. 
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Fig. 5. Sequency power spectra of two equal amplitude signals. 
Upper plot: fj - 2000 » 23 OO 'S;^^ 

Lower plot : f =» 2000 S^^ “ 2U00 
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Fig. 6. Upper plot: Sequency power spectrum (f = 6o60 

for which the side lobe is larger than the main lobe. 
Lower plot: Sequency power spectrum for f =» 8080'S^?" 
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There also appears to be an effect of weak signal suppression when one 
signal Is much smaller than the other. This Is Illustrated In Fig. 7 In which 
one signal Is 5 times larger than the other. 

4 

Conclusions 

The only firm conclusion that can be reached at this time Is that FHT 
methods are not thoroughly understood. On a more positive note, aome tentative 
conclusions are: 

a) So far as computation time is concerned, it is certainly less than the FFT, 
but how much less is not clear. 

b) The desired sequencies can always be detected (in the noise-free case) but 
there may be false alaras introduced by the sidelobes. 

c) The apparent weak-signal suppression is probably an artifact of the particular 
computation rather than a fundamental limitation of the method. Like other 
transform methods, the FHT is linear and should not exhibit this effect in 
general, although it may for certain combinations of sequencies because of 
sidelobe interference. 

It is clear that the available results for the FHT methods are still too 
fragmentary to be able to predict the eventual success of this technique. In 
particular, the effects of noise and the peculiarities of the sidelobes must be 
investigated further. 

2.4 FILTER BANK METHODS OF COARSE FREQUENCY MEASUREMENT 
2 . 4.1 Objectives 

Another obvious method of detecting the presence of sinusoids of unknown 
frequency is the use of a bank of parallel filters tuned to contiguous frequency 
bands. For the parameters of the present study this would require 100 to 3 OO 
filters, depending upon the resolution required, and this number is deemed too 
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large for use of conventional filter structures. The alternative proposed was 
the use of digital filters, each scanning a pre-assigned portion of the overall 
frequency band. 

The objective of this Investigation is to determine the relative advantages 
and disadvantages of the digital filter bank with respect to processing time, 

memory requirements, and system complexity. 

! 

2.U.2 Discussion of Results 

The investigation of digital filtering has been rather limited. Possible 
ways of implementing such a filter have been looked at and one possible technique 
Is illustrated in Fig. 8. No analysis of its performance has been carried out. 

2.4.“^ Conclusions 

Because of the lack of analysis, no firm conclusions regarding the feasibility 
of digital filtering have been reached. It has been tentatively concluded that 
the performance would be similar to the FFT but slower because there is no fast 
algorithm available and it is serial processor. Of course, savings in time can be 
achieved by using parallel processing of several bands simultaneously. 

2.5 PHASE-LOCK LOOP FOR FINE FREQUENCY MEASUREMENT 

2.5.1 Objectives 

After the various frequency components of the received signal have been 
Identified, it is necessary to lock on to each one in a separate sub-system in 
order to recover the Information data. The phase-lock loop is proposed as the 
appropriate mechanism for acquiring the proper frequency and phase. 

The objectives of this task are to determine the most appropriate configuration 
for the phase-lock loop and to evaluate its performance. 
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2>5>2 Discussion of Results 

Two different phase-lock loops have been considered. One of these is the 
squaring loop that removes the modulation (when it is PSK with + 90^) by squaring 
the signal and operating at twice the carrier frequency. A block diagram of 
this loop is shown in Fig. 9* 

The second method considered is the Costas loop that employs in-phase and 
quadrature feedback paths to remove the modulation (again assuming PSK with +90^). 
A block diagram of this loop is shown in Fig. 10. 

The analysis of these phase-lock loops is only partially completed. The 
analysis techniques are the standard ones suggested by Stiffler and Lindsey, but 
no quantitative results have been obtained yet. 

2.5.^ Conclusions 

The only conclusion that has been reached so far concerning the fine 
frequency measurement is a tentative one that the performances of the two phase 
lock loops are essentially the same. If this turns out to be true, then the 
choice of method depends primarily upon the relative ease of implementing the 
two techniques. 

2.6 ERRORS IN FREQUENCY IDENTIFICATION 
2.6.1 Objectives 

The coarse frequency measurements attempts to create peaks in the frequency 
spectrum or sequency spectrum of the observed data in order to identify the 
specific frequencies present. In the presence of noise, the correct peaks may 
be obscured or spurious peaks may be created. Hence, the objective of this task 
is to evaluate the effectiveness of a given coarse frequency measurement by 
establishing the probability of detection for the correct peaks and the proba- 
bility of false alarm for the spurious peaks. 
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2«6.2 Discussion of Results 

Only the FFT method has been investigated with respect to its error 
performance. The error analysis has been carried out by treating each estimate 
of the frequency spectrum as a random variable whose probability density func- 
tion depends upon the magnitude of any signal components and their frequencies. 

A threshold is established and if the estimated spectrtim lies above this 
threshold a decision of signal present is made. 

The effectiveness of this decision operation can be expressed in terms of 
the probability of detection, Pp, and the probability of false alarm, Pp. The 
former is the probability that the spectral estimate of noise plus signal will 
exceed the threshold, while the latter is the probability that the spectral 
estimate of noise only will exceed the threshold. 

The signal-to-noise ratio, R, of the spectral estimate is defined as the 
ratio of the expected value of the estimate when signal is present to the 
expected value of the estimate when only noise is present. Under suitable 
assumptions, the resulting probability density function is Chi-square with 
degrees of freedom where § is determined by the smoothing as indicated in ( 2 - 8 ). 
Specifically it becomes 

® r 1) _2S 

Py(x;§;R) = ( 2 -I 3 ) 

r =0 2 (r+|) |T(r + |)r! 

where X = 

c 

and is the Fourier coefficient defined in (2-1). This probability density 
function has been computed for numerous conditions and typical examples are 
shown in Figs. 11, 12, and I 3 for various values of signal-to-noise ratio, R and 
with the degrees of freedom, 5 » a parameter. In all cases the abscissa is pir«por»***’«* 




Probability density function of spectral estimates of noise only 
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the noraallzed power level, x. ' 

Using the probability density function of ( 2 -I 3 ) one can compute the 
probabilities of detection and false alarm for any signal-to-noise ratio and 
any number of degrees of freedom. If the decision threshold is set at x = 6, 
then these probabilities become^ 5-2. 



r=0 i=0 


(2-14) 


-6 

e 


(2-15) 


One way of presenting the results of (2-14) and ( 2 -I 5 ) is to plot curves of 

Pj^ as a function of R, with as a parameter. One such set of curves, for 2 

-1 -7 

degrees of freedom, is shown in Fig. Ik for P^ values ranging from 10 to 10 . 

Another way of presenting the same results is to plot curves of Pj^ as a 
function of R, with ^ as a parameter. This indicates how smoothing affects the 
probability of detection. One such set of curves, for P^ » 10 , is shown in 

Fig. 15 . 

Many computations similar to those of Figs. 11 thru I 5 have been made, and 
the results presented are intended to be illustrative of these. 


2.6*^ Conclusions 

The conclusions that can be drawn as a result of this study pertain to 
Fourier transform methods only, since this is the only situation that has been 
Investigated. Some fairly firm conclusions that can be made are: 
a) It Is a relatively easy matter to calculate Pj^ and P^ for a wide variety of 
cases when the FFT methods are used. Thus, the evaluation of this technique 


is straightforward. 
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b) The values of Pjj obtained by this computation are consistent with those 
that might be estimated from plots of the frequency power spectra. 

c) As a typical reference point, it is seen from Fig. 14 that a slgnal-to>noise 
ratio of 10 dB (for the spectral estimate) leads to a probability of detection 
of 0.95 when there are 2 degrees of freedom (no smoothing). This corresponds 
to an input signal-to-noise ratio of about -12 dB. 

2.7 BRIEF summary OF OTHER TASKS 

2.7.1 Implementation of Coarse Frequency Measurement 

Block diagrams of the hardware needed to accomplish the coarse frequency 
measurement by either the FFT or the FHT have been sketched. They are not 
presented here, however, because they are still tentative. 

2.7.2 Use of Hard Limiting 

It was suggested in the original proposal that the input signal and noise 
be hard limited before estimating the spectrum. This approach does not seem 
' feasible, however, because of the suppression of weak signals and the creation 
of difference frequency components that would obscure the spectral estimates. 

No further work has been done on this idea. 

2 , 7 .'^ Data Modulation and Demodulation 

The use of PSK has been assumed throughout the analysis and no further 
consideration has been given to this problem. In particular, the trade-offs 
between PSK and DPSK have not been explored. 

2.7.4 Message Format Design 

The basic concepts of message format design were discussed in the original 
proposal. The mathematics for solving this optimization problem has been set-up 
but no solutions have been attempted. It should be noted, however, that the 
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solution of this problem will have an important bearing on the coarse frequency 
measurement . 

Some work has been done on the synchronization problem, but this has not 
reached a sufficiently definitive stage to be worthy of reporting. No effort 
has been devoted to the suggestion that the preamble could be eliminated by 


storing the signal. 



SECTION 3: RECOMMENDATIONS FOR FUTURE EFFORT 

3.1 INTRODUCTION 

If effort on this program is to be continued, it is essential to identify 
those tasks that are both worthwhile and feasible. The following discussion 
attempts to do this by considering tasks in three different categories: 

a) Those tasks currently under investigation, or contained in the original 
proposal, that should be continued or initiated. 

b) Those tasks in the original proposal that should be terminated or not 
initiated. 

c) New tasks, some contained in the most recent proposal, that should be 
initiated. 

The following subsections identify the above tasks, make specific recommendations, 
and briefly indicate the reasons for these recommendations. 

3.2 CONTINUING TASKS 

^. 2.1 Fast Walsh-Hadamard Transform Methods of Coarse Frequency Measurement 
The FHT methods have the advantage of being computationally efficient but 
there are many unanswered questions concerning their interpretation and use. 

These include: 

a) The proper interpretation of the sequency spectrum for sinusoidal signals 

b) The significance of sidelobes on the sequency spectrum in creating 
false alarms. 

c) The apparent weak signal suppression for some combinations of frequencies 
If the investigation of FHT methods is continued, it should concentrate on: 

a) The possibility of controlling the sidelobes of the spectrum by the use 


of appropriate weighting functloiis. 

b) The effects of noise on the computation of sequency spectra, partic- 
ularly with regard to establishing the minimum acceptable signal-to- 
noise ratio. 

^.2.2 Digital Filter Bank 

The investigation of the digital filter has not yet reached a satisfactory 
termination point. Although this approach does not look promising at the 
present time, this conclusion should be either verified or corrected. 

'^.2.'^ Phase-Lock Loop 

The analysis of the phase-lock loop for fine frequency measurement should 
be continued to the point of being able to specify performance and to select the 
most useful form of loop. 

•^.2.4 Message Format Design 

It is essential to conclude the analysis of synchronization and to establish 
the optimum message format. However, this task need not be pursued in great depth 

'^.2.5 System Error Analysis 

The analysis of errors in frequency identification needs to be extended to 
other methods of coarse frequency measurement such as the FHT or some other 
method yet to be considered. This is an essential part of determining the 
relative effectiveness of the various methods. 

Some analysis of data transmission errors is also needed but this is 
primarily an application of known techniques to the specific problem at hand. 

It is not envisioned that this will involve any extension of existing 


theory. 


3*3 DISCONTINUED TASKS 


3*3*1 Fast Fourier Transform Methods of Coarse Frequency Measurement 

It appears that the analysis of the FFT has reached a point where it 
should be terminated, except for the final write-up and conclusions. It is 
more important at this time to bring the analysis of other methods of coarse 
frequency measurement to a similar level of completeness in order that final 
decisions on the approach can be made. 

There may be some justification for looking at some modified FFT approaches, 
as indicated in a subsequent section. 

3*3*2 Implementation of the Coarse Frequency Measurement 

This task should be discontinued, at least until a final decision is made 
on the method to be used. However, since the evaluation of computation time is 
an important element in evaluating various methods, this aspect of the imple- 
mentation must be continued. 

3*3*3 Data Modulation and Demodulation 

Since the assumption of PSK or DPSK seems to be well founded, there is 
little point in initiating activity in this area. Of course, if future effort 
Indicates some definite advantages to be gained from large time- bandwidth 
waveforms and M-ary signalling, then this task would again become a crucial item. 

3.3*4 Data Reduction 

Although the eventual consideration of data reduction methods is vital to 
the design of the overall system, it does not appear to be an essential aspect 
of the detection and estimation problems that have been considered on this project 
so far. It is recommended that the effort on detection and estimation not be 
diluted by imposing a task on data reduction. 
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3.4 NEW TASKS 

•^,4.1 Theoretical Limitations 

The fundamental problem of establishing limits on the accuracy of coarse 
frequency estimates has not been treated in any detail so far. A superficial 
look at the Cramdr-Rao bound on such estimates indicates that the accuracy of 
estimating an isolated frequency component (in the presence of noise) is 
considerably better than the resolution obtainable with the FFT or FHT. This 
suggests that these are not efficient estimation techniques for Isolated 
frequencies. The Craraer-Rao bound also can be evaluated for two or more closely 
spaced frequency components, but this has not been done. It may well turn out 
that the transform methods are not nearly as inefficient in this case. 

It is suggested that these theoretical limits be Investigated in order to 
provide an indication of how good practical estimation methods are. This is 
not a large task, but should provide much useful insight. 

"^.k.2 Adaptive Transform Methods 

Two new methods of estimating power spectra have recently been proposed. 

These are the maximum likelihood method (MLM) proposed by Capon, and the maximum 
entropy method (MEM) proposed by Burg. More recently La Coss has demonstrated 
that these methods give substantially better resolution of sinusoidal signals in 
the presence of noise than do the classical methods. 

It appears that some consideration should be given to the MLM and MEM, 
although it is likely that they are too time-consuming even though fast algorithms 
are available for both. 

'^.4.'^ Nonlinear Processing 

The knowledge that the signals to be detected are sinusoids can be utilized 
by employing nonlinear techniques to increase their separation in hertz. Such 
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: nonlinear operations will also increase the noise but there may be a net 
Improvement in resolvability. It appears that this possibility should be 
explored, at least to the extent of evaluating its potential. 

Another approach to nonlinear processing is to examine the distribution 
of zero crossings of either the signal or its* autocorrelation function. Such 
techniques have proven useful in weak signal detection in the past and might 
also be useful here. Unfortunately, there is very little relevant theory 
available on this problem so it would probably have to be attacked by a computer 
simulation; 

There are undoubtedly many other nonlinear processing methods that could 
also be considered and some serious effort spent in contemplating some of these 
might be most fruitful. 


